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Evasion 

Pradlctlon 


1.  IntroJttctloa. 

Tbs  caMa  that  wa  ara  talkint  about  are  two  peraon>  aero-aiai 
(MM*  that  raault  la  aa  Bvadar  balas  althar  fcUlad  or  oot  fclllad  by 
aa  Attackar.'  Siaea  tha  Attaekar  aaploya  a  waapoa  that  rctiulrea  a 
cartala  aaouat  of  tlaa  T  for  dalivary,  a  aajor  part  of  his  task 
la  tha  pradletloB  of  iriiat  tha  Evadar  will  do  during  tha  next  T, 
so  that  aa  squally  good  naaa  for  bla  would  ba  "Pradlctor." 

Tha  classic  azaapla  of  such  a  gaaa  la  "boabar  vs.  battlaahlp." 
Tha  boabar  la  aaauaad  to  have  one  boab.  Infinite  endurance,  and  per¬ 
fect  ala,  so  that  tha  battleship's  only  chance  of  survival  Ilea  in 
tha  boabar 'a  Inability  to  predict  the  aotlon  of  the  battleship 
during  tha  nsxt  T.  Tha  gaaa  la  trivial  If  the  battlaahlp  knows 
tha  tlaa  at  which  the  boab  la  dropped;  both  the  boid>  and  toe  battle¬ 
ship  should  be  placed  randoaly  within  whatever  area  A  the  battleship 
can  reach  la  T,  and  the  payoff  is  the  ratio  of  the  lethal  area  to 
A.  If  the  battleship  does  not  know  when  the  boab  is  dropped,  then 
the  problaa  la  not  trivial.  Ve  shall  discuss  this  problea  further 
la  the  sequel. 

A  aore  aodem  couaterpart  of  the  above  gaae  la  the  ICM  vs. 
trailed  ship  gaaa,  where  perhaps  several  nuclear  weapons  are  launched 
In  a  surprise  attack  against  soae  sort  of  naval  target.  Muclear 
weapons  ara  vary  powerful,  but  a  aodem  ship  can  also  travel  soae 
distance  In  half  an  hour,  so  that  the  outcoae  la  not  obvious.  The 
aatheaatlcal  assiaptlons  that  have  to  be  aade  in  this  gaae  arc 
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probably  closer  to  the  real  world  than  they  were  In  the  days  of 
bowbers  and  battleships,  so  that  the  gene  Is  of  more  than  acadesdc 
Interest.  It  Is,  strictly  speaking,  unsolved,  as  Is  the  ICBH  vs. 
railroad  train  game,  which  Is  the  one  dimensional  equivalent. 

Another  example  of  a  Time  Tagged  Evasion  Game  Is  the  anti¬ 
aircraft  gun  vs.  airplane  game,  where  the  lethal  radius  and  time 
lag  are  both  scaled  down  considerably  from  the  bomber  vs.  battle¬ 
ship.  This  game  differs  fundaaientally  from  the  latter  In  that  the 
AA  gun  fires  at  awny  distinct  points  of  time,  with  the  times  of 
firing  bearing  little  relationship  to  the  maneuvers  of  the  target. 

This  distinction  results  In  the  SKS  error  being  the  appropriate 
payoff  and  leads  to  the  Introduction  of  filtering  techniques. 

The  examples  above  should  make  it  clear  that  the  time  lag  is 
what  makes  these  games  unique  and  interesting.  It  also  makes  them 
non-lntultlve,  at  least  In  the  sense  that  nature  provides  very 
little  instruction  In  how  to  play  them.  One  can  presumably  learn 
something  about  pursuit  by  watching  natural  predators  and  their 
prey,  and  there  are  many  other  combat  situations  where  nature  pro¬ 
vides  guidelines.  But  the  ability  to  kill  at  long  range  la  unique 
to  modern  man,  and  we  must  therefore  expect  intuition  to  be  a  fallible 
guide  in  what  follows. 
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2.  Models  Derived  from  the  Bomber  vs.  Battleship  Game. 

We  will  refer  to  the  Bomber  as  A  and  the  Battleship  as  E, 
and  we  make  the  following  assimiptlons : 

1)  Both  sides  have  Infinite  endurance. 

2)  E's  motion  Is  unrestrained  except  that  his  speed  must 
never  exceed  V.  In  particular »  E  can  make  sharp 
turns  If  he  likes. 

3)  A  can  warp  the  shape  of  the  lethal  region  In  any  way 
he  likes,  so  long  as  the  area  of  the  region  Is  S. 

It  Is  not  Intuitively  obvious  that  the  above  gsme  Is  difficult. 

In  fact.  It  Is  clear  that  A  will  always  have  E  located  to 

within  a  circle  of  radius  VT,  so  that  he  can  achieve  a  kill  prob- 
2 

ability  of  S/it(VT)  by  simply  choosing  the  lethal  region  randomly 
within  the  circle  (a  wedge  of  random  orientation  will  do) .  On  the  other 
hand.  If  E  maneuvers  in  such  a  way  that  the  probability  density 

of  his  position  Is  uniform  within  the  circle  of  uncertainty  at  the 

2 

moment  of  Impact,  then  the  kill  probability  will  be  S/ii(VT)  no 

2 

matter  what  lethal  region  A  chooses.  Therefore,  S/ir(VT)  is 
the  value  of  the  game,  as  long  as  E  can  behave  as  described.  The 
trouble  with  this  analysis  Is  that  E  cannot  make  the  probability 
density  of  his  position  Increment  uniform  at  the  moment  of  Impact. 

It  would  be  easy  If  E  knew  when  the  bomb  was  dropped  because  his 
assumed  ability  to  make  sharp  turns  would  permit  him  to  simply  pick 
a  point  at  random  within  the  circle  of  uncertainty  and  go  there. 

But  E  doesn't  have  that  critical  piece  of  information,  and  there¬ 
fore  doesn't  know  when  to  start  the  maneuver.  Still,  Intuition  may 


4 

argue  that  E  can  achieve  the  saae  effect  by  'W>vlng  around  com¬ 
pletely  at  random  all  the  time."  Unfortunately,  this  Instruction  Is 
not  specific,  and  attempts  to  make  It  specific  lead  to  non-uniform 
distributions  at  certain  times. 

To  Illustrate  how  this  happens,  ve  consider  the  following 
strategy  for  E  In  the  one  dimensional  analog  (Bomber  vs.  Railroad 
Train),  idiere  S  Is  now  a  length,  rather  than  an  area:  At  time 
0(t“0)  pick  a  velocity  uniformly  from  [-V,V],  and  stick  to  it  for 
T.  This  will  certainly  make  the  position  at  T  uniform  throughout 
the  Interval  of  uncertainty.  At  T,  repeat  the  procedure  with  an 
Independent  choice  of  velocity,  and  continue  ad  Infinitum.  Let  us 
explore  the  consequences  of  this  policy.  At  time  T/2>  the  Incre¬ 
ment  to  E's  position  over  the  next  T  is  J +  2^  where 

and  V2  are  the  first  two  random  velocities.  Since  the  veloci¬ 
ties  are  independent,  the  probability  density  of  the  sum  can  be 
found  by  convolving  the  uniform  density  with  Itself.  The  result 
is  triangular,  and  is  shown  as  one  of  the  densities  In  Figure  lA. 

If  this  policy  for  E  were  optimal,  he  could  announce  It  to 
A  without  hurting  his  chances  (A  can  figure  It  out  for  himself 
anyway,  since  he  has  lots  of  time  available).  In  response,  A 
might  use  the  firing  policy  "straddle  the  present  position."  If 
S  -  VT,  It  can  be  seen  that  this  policy  would  cut  out  3/4  of  the 
probability  density  function  at  t  -  T/2,  so  the  highest  kill 
probability  is  at  least  3/4.  Figure  IB  Is  a  plot  of  kill  proba¬ 
bility  (P^)  vs.  time.  It  shows  that 
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1)  The  highest  available  la  3/4. 

2)  >  1/2(>‘S/2VT)  Is  available  only  at  multiples  of  T. 

3)  The  average  kill  probability  Is  closer  to  3/4  than  to 
1/2,  since  the  scallops  are  concave. 

In  other  words,  the  stated  strategy  for  E  does  not  make 
the  T-lncrement  of  his  position  "uniform  all  the  time." 

A  has  a  better  strategy  than  straddling  that  Involves  extrap¬ 
olation.  Specifically,  at  time  t  -  5,  will  have  observed  the  first 
velocity  V^,  and  can  cpnsequently  predict  exactly  where  E  will 
be  at  T.  By  killing  an  Interval  of  length  2V6  around  that  point, 
he  can  guarantee  a  kill,  and  since  6  Is  arbitrary,  A  can  guar¬ 
antee  a  kill  as  long  as  S  >  0  (assuming  a  noiseless  tracking  system 
that  Is  able  to  measure  a  velocity  In  an  arbitrarily  small  amount 
of  time).  Thus,  by  paying  careful  attention  to  E's  track,  A  can 
actually  guarantee  to  kill  E  If  E  uses  the  stated  policy. 

Obviously,  the  trouble  with  E's  strategy  Is  that  his  motion 
Is  predictable  over  long  periods  of  time;  once  he  picks  a  velocity, 
he  sticks  to  It  for  T.  A  natural  way  to  Improve  E's  strategy  Is 
to  make  many  Independent  velocity  decisions  within  each  T,  rather 
than  Just  one.  Intuition  may  lead  to  the  conclusion  that.  If  E 
makes  enough  of  these  Incremental  decisions  within  each  interval, 
then  the  T-increment  of  his  position  (1^)  will  be  uniform  for 
all  t.  This  Is  false;  what  actually  happens  Is  that  E  can  reli¬ 
ably  be  expected  to  not  go  anywhere.  If  there  are  N  Independent, 
Identically  distributed  velocity  choices  In  T,  then 
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V*r(I^)  -  I  V«r(|  V^)  -  N  V«r^  V^)  -  J  V*r(V^), 

«o  that  11»  Var<l^)  •  0.  Coosaqueatly,  thla  sort  of  stratagy  tiUl 
alao  laad  to  E's  baing  klllad  with  probability  1  avan  whan  S 
la  vary  aaall. 

Mot  only  have  wa  failed  to  diacovar  a  strategy  for  E  that 
will  guarantee  ac  S/(2VT),  but  we  have  failed  to  produce  a 
strategy  for  E  that  will  penlt  hla  to  survive  with  any  positive 
probability,  even  against  a  weak  opponent.  E  seau  to  be  caught 
la  a  dUauM  between  turning  Infrequently,  In  idilch  case  he  Is  vul¬ 
nerable  to  simple  extrapolation,  and  turning  frequently,  in  which 
case  he  has  to  fight  the  Law  of  Large  Rusbers.  In  addition,  be  Is 
handicapped  by  the  fact  that  A  can  wait  for  a  nexinusi  of  p^ 
before  he  fires,  since  A  has  infinite  endurance  and  can  drop  the 
bomb  whenever  he  likes. 

The  previous  paragraphs  will  have  served  their  purpose  If  the 

reader  is  now  convinced  that  the  game  is  not  simple,  and  that 

"moving  around  at  random"  will  not  guarantse  that  p^^  m  S/(2VT) 

2 

(or  P|.  m  S/v(VT)  in  two  dimensions). 

2.1  A  Eeasonable  Evader  Stratify. 

Since  A  can  be  expected  to  pick  the  msxlmiai  of  the  p^ 
vs.  t  curve,  a  reasonable  strategy  for  E  is  to  behave  in  such 
a  manner  that  p|^  does  not  depend  on  t;  l.e.,  the  curve  is  flat. 
E  can  accoiVllsh  this  by  making  independent  direction  change 
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choices  St  times  corresponding  no  the  jumps  In  a  Poisson  Process. 

This  follows  from  the  fact  that  In  a  Poisson  Process  the  time  until 
the  next  jump  Is  always  an  exponential  random  variable  trlth  mean 
1/X,  regardless  of  when  jumps  have  occurred  In  the  past.  The 
T-lncrement  of  E's  position  follows  a  probability  law  that  does 
not  depend  on  t,  and  the  constant  kill  probability  can  be  found 
by  maximizing  the  amount  of  probability  that  A  can  "cut  out"  with 
S.  In  one  dimension,  E  Is  left  with  the  single  parameter  X  with 
which  to  minimize  that  maxlmHm  (the  "turn  probability"  at  each 
decision  point  can  be  taken  to  be  1.0,  since  a  smaller  number  Is 
equivalent  to  changing  X).  In  two  dimensions,  E  controls  both 
X  and  the  common  D.F.  P(6)  of  the  successive  direction  changes. 

In  one  dimension,  the  probability  density  of  random  variable 
X  -  I^/(VT)  Is  11] 

fjj(x)  -  e~“d(x-l)  +  o  Ij^(a/l-x^)),  (1) 

where  a  ■  XT,  I^.  Is  the  modified  Bessel  function  of  order  K, 
and  the  positive  direction  for  x  Is  the  last  direction  of  travel 
(-1  <  X  a  1} .  The  d-functlon  term  corresponds  to  the  probability 
e~^  that  E  will  not  turn  at  all  In  T.  Figure  2  shows  plots  of 
the  continuous  part  of  f  (x)  for  3  values  of  a,  the  optimal 

A 

area  for  A  to  cut  out  In  each  case  when  S  ■■  VT,  and  the 
associated  p^^  (A  also  covers  the  single  point  x  -  1,  getting 


FIGURE  3. 
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e”**  *t  no  cost).  Fi^re  3  shows  vs.  o  when  S  ■  VT;  the 

best  a  Is  2.3,  and  the  aiinlanim  is  about  2/3.  Note  that 

a  is  the  expected  niad>er  of  turns  within  any  period  of  length  T; 
too  few  turns  leads  to  vulnerability  to  extrapolation  (e“®  is 
large),  and  too  many  turns  leads  to  trouble  with  the  Law  of  Large 
Nuabers  (^yCx)  becomes  concentrated  around  x  -  0).  The  optimum 
a  decreases  with  S;  it  is  a  curious  fact  that  E  exhibits  the 
most  frantic  behavior  against  the  weakest  opponent. 

2.1.1  Approximation  for  Weak  Attacker. 

The  mlnaax  p^  is  a  function  of  the  ratio  S/(2VT)  =  s. 

There  is  no  analytic  representation  in  general,  but  it  is  possible 
to  obtain  a  limiting  form  for  small  s.  To  do  so,  we  first  obtain 
the  symmetrical  form  of  (1)  that  results  from  randomizing  E's 
first  move;  the  resulting  advantage  for  E  will  be  negligible  when 
a  is  large.  The  resulting  density  function  is  l/2(f^(x)  +  fj^(-x)), 
the  continwus  part  of  which  is 

-o 

f  (x)  -  o  ^  (1^(0.^^)  +  1.  (o/T^))  (2) 

Since  the  power  series  for  1^^  has  no  constant  term,  f(x)  is 
decreasing  for  x  m  0,  and  the  best  strategy  for  A  is  therefore 
to  straddle  the  origin  in  addition  to  hitting  the  points  -1  and 
■fl.  An  asyiaptotic  expansion  for  ^(>) 
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/2ir£ 


(1  +  *1^/*  +  •••)» 


so  that  f  (0)  a  for  large  a.  For  the  laoMnt,  we  assuM 

that  £(x)  Is  well  approximated  by  f(0)  within  the  straddle,  so 
that  the  kill  probability  for  given  a,  s  Is  approximately 


e“®  +  2a 


/  2v  ’ 


(3) 


%ihere  e  Is  the  probability  that  no  turn  will  be  made. 

For  convenience,  let  x  *  and  v^  ■  a.  Then  the  alnluw 

2 

kill  probability  Is  Pj.  ■  min  (e”®  +  2xi^)  ■  min  (e^  +  2vx). 

020  vkO  2 

Equating  the  v-derlvatlve  to  0,  we  find  that  x  >  ve~^  and 

2  2 
Pjj  ■  e”^  (1  +  2v2).  There  will  be  two  solutions  to  x  ■  ve"^ 

1  -1/2 

If  X  ac  —  e  ,  and  none  otherwise.  Only  the  larger  of  the  two 

/2 

solutions  can  be  a  minimum,  since  the  Initial  slope  Is  positive. 

In  other  words,  p(x)  could  be  generated  parametrically  for  small 

X  by  using  large  values  for  v.  But  It  Is  possible  to  obtain  an 

1  +  2v2 


explicit  solution.  Let  y  ■  F  * 


which  nuad>er 


Is  never  leas  than  Solving  for  v,  we  find  that  v  ■ 

4 

-v2 

taking  the  larger  of  the  two  roots.  Since  x  -  ve  ,  we  therefore 
have 

i2 


-  !.«['  *  ■  -  1.. 


(4) 
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ilb«a  ■  .5,  we  earlier  found  that  the  correct  kill  proba¬ 

bility  la  .665  at  a  ■  2.3.  For  s  .5,  (4)  gives  x  -  .2, 

■  1.6,  y  >  3.42,  and  p^  ~  .685,  thus  advising  E  to  turn 
soaevfaat  less  frequently  than  he  ought  to,  and  slightly  exaggerat¬ 
ing  the  nlnlnun  kill  probability. 

When  X  is  very  snail,  y  Is  very  large.  If  we  approxinate 
V  with  y/2  and  ignore  the  log  v  tern  In  (4),  the  result  Is 
y  s  2/-log  X.  Recalling  that  y  ~  ~  s//^,  this  is 


E  night  have  hoped  for  better,  since  the  kill  probability  would  be 
only  8  If  he  could  achieve  the  ideal  of  naklng  his  position 
Increnent  a  unifom  randon  variable. 

When  E  uses  the  specified  a,  f(0}  Is  s  good  approxinatlon 
to  f(x)  within  the  straddle.  To  prove  this,  note  that 

f"(0)/f'<0)  -  CO,  so  that  lin  s2f"(0)/f  ’  (0)  -  lln  e"®)*  -  0. 

o  *** 

2.2  The  Problen  in  TWo  Dlnenslons. 

In  two  dlnenslons,  E  controls  a  directional  D.F.  F(9),  as 
well  as  the  rate  oi  turning  X.  The  problen  of  finding  the  proba¬ 
bility  law  for  the  T-increnent  of  the  Evader's  position  Is  unsolved, 
except  for  the  case  F(e)  -  6/2v  for  0  c  0  n  2v  (the  unifom  D.F.). 


11 


I 

\ 

k 

\ 

I 

f 

In  this  case,  the  joint  density  function  of  (X,Tf)  ■  (I^*VvT,I^^^/VT) 
is  [2] 

f,_,<x.y)  -  .-”s<y)«x-l)  .-.(l-rt-xx-yx) 

for  -t-  y2  ^  1,  Where  the  positive  x  direction  is  the  last 
direction  of  travel,  and  a  >  XT  as  before.  By  numerically  inte¬ 
grating  this  function,  and  minimizing  the  Integral  with  respect  to 
a.  Figure  4  can  be  computed.  That  figure  represents  the  current 
"state  of  the  art"  as  far  as  the  Bomber  vs.  Battleship  game  is 
concerned;  value  of  the  game  (assuming  one  exists)  is  a  survival 
probability  (l-p^^)  somewhere  between  the  upper  and  lower  bounds 
that  are  shown.  It  is  not  known  whether  or  not  the  optimal  strategy 
for  E  is  a  Poisson  Strategy  of  the  type  Just  considered,  or  even 
whether  the  uniform  distribution  on  angles  is  optimal  within  the 
class. 

2.3  The  Discrete  Evasion  Game. 

The  Bomber  vs.  Battleship  game  discussed  above  was  the  subject 
of  some  effort  at  the  RAND  Corporation  in  the  1950's.  Finding  the 
game  to  be  too  difficult  for  exact  solution,  Isaacs  and  others 
decided  to  formulate  approximate  gmses  that  could  be  solved  exactly, 
rather  than  to  try  to  approximate  the  value  of  the  exact  game.  In 
Isaacs'words  [3], 
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FIGURE  4. 

SURVIVAL  PROBABILITY  FOR 
OPTIMUM  CCT. 
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"To  gain  a  foothold,  we  simplified  It  further.  We  made 
the  ocean  one-dlmenalonal  and  dlacrete.  That  la,  we 
suppoaed  the  battleahlp  to  be  located  on  one  of  a  long 
row  of  points  and  at  each  unit  of  time  he  hops  to  one 
adjoining  one,  enjoying  the  sole  choice  of  a  right  or 
left  jump.  The  time  lag  was  to  be  an  Integral  number  n 
of  time  units,  or — the  same  thing— of  jumps.  This  Is 
tantamount  to  saying  that  the  bomber  knows  all  positions 
of  the  battleship  which  precede  his  present  one  by  n 
jumps  or  more.  If  n  ~  1,  the  boiid>er  knows  all  but  the 
most  recent  of  the  ship's  positions  and  there  are  but  two 
possibilities  for  that:  one  space  to  right  or  left  of  the 
last  observed  one. 

This  case — n  ■  1 — Is  trivial.  The  ship  makes  each  decision- 
left  or  right — by  the  toss  of  a  coin.  The  bomber  can  bomb 
at  any  time  and  when  he  does  he  also  decides  between  the 
two  possibilities  %rlth  a  coin.*  Then  the  value  of  the  game 
(hit  probability)  Is  1/2. 

Our  Intention  was  now  to  take  up  n  ■  2,3,4,...  and,  from 
the  knowledge  gained,  proceed  to  the  continuous  case. 

Thence  we  hoped  to  restore  planarity  to  the  ocean  and 
approach  practicality  by  more  realistic  assumptions  about 
the  ship's  kinematics,  accuracy  of  the  bomber,  number  of 
bombs,  etc. 

But  the  case  of  n  >  2  proved  to  be  an  Incubus.  A  consid' 
erable  amount  of  effort  by  several  people  was  expended  before 
Its  shell  began  to  crack.  This  paper  will  be  the  third  one 
devoted  to  It;  see  [1,2].  We  can  expect  the  general  class 
of  alsdng — ^and — evasion  problems  to  be  more  difficult  than 
anticipated,  but  by  no  means  hopeless." 


*(For  the  game  theory  tyro  only.)  If  at  some  time,  the  ship 
elected,  say,  the  probabilities:  Left:  .6;  Right:  .4, 
the  bomber  need  only  wait  for  this  time  and  bond)  on  the 
left;  then  hit  probability  <■  .6.  Similar  considerations 
hold  vice  versa.  Thus  the  unique  optimal  strategies 
require  50-50  decisions  on  the  parts  of  both  players. 


13 


The  reader  la  referred  to  [3]  for  a  coaplete  dlscuaalon  of 
the  case  n  -  2.  Briefly,  the  aolutlon  was  found  by  beginning  with 
the  Intuitively  plausible  Markov  Hypothesis:  In  the  n  step  gaae, 
the  probability  that  E  will  go  right  or  left  on  any  given  wove 
may  depend  on  the  previous  n  1  steps,  but  will  not  depend  on 
steps  further  In  the  past  than  the  n  -  1  .  The  assiaaptlon  Is 
plausible  because,  "Why  should  B  let  his  behavior  depend  on  Infor¬ 
mation  that  A  already  knows?"  Note  that  the  assumption  holds 
when  n  -  1,  since  E  flips  a  coin  each  time  regardless  of  what 
he  did  the  previous  time.  When  n  >  2,  E  will  presumably  maintain 
a  constant  probability  of  turning  (x),  since  one  can  "turn"  know¬ 
ing  only  what  was  done  on  the  previous  step.  E's  direction  of 
travel  can  then  be  extrapolated  for  2  steps  with  probability 
(l-x)2.  With  probability  x(l-x),  E  will  be  at  the  opposite 
extreme  In  2  steps.  This  leaves  a  probability  of  1  -  (1-x)^  - 
x(l-x)  X  for  the  center  point  (no  net  movement).  Thus,  E  can 
guarantee  a  kill  probability  no  larger  than 


V  -  min  max  {(1-x)^,  x,  x(l-x)}. 

0«xml 

The  minimum  occurs  when  x  *  (1-x)^,  in  which  case  x  ■  — j - - 

.382  -  V.  This  number  turns  out  to  be  the  value  of  the  game,  but 
the  proof  of  the  fact  Is  not  easy.  Three  different  proofs  can  be 
found  In  [3],  [4],  and  [5].  The  proofs  are  made  somewhat  difficult 
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because  the  maximizing  player  has  no  optimal  stragegy;  he  can 
guarantee  a  p^^  arbitrarily  close  to  V,  but  he  can't  guarantee 
V.  Intuitively,  A  has  no  optimal  strategy  because  It  always  pays 
to  wait  a  little  longer  before  firing,  but  it  doesn't  pay  to  wait 
"forever"  before  firing — the  two  rules  are  in  conflict. 

The  results  for  the  2-step  game  have  been  extended  somewhat. 

3-/5 

In  [5] ,  Ferguson  showed  that  V  - - ^ —  is  a  special  case  of 

v^  >  (n^2-n/n‘^)/2,  where  n  -t-  1  is  the  number  of  edges  connected 
to  each  vertex  In  certain  special  graphs  that  he  calls  restricted 
n-graphs.  For  example,  a  lattice  of  hexagons  Is  a  restricted  2- 
graph,  and  the  Integers  are  a  restricted  1-graph.  Since  a  restricted 
n-graph  may  have  no  four-sided  figures,  the  square  lattice  Is  not 
a  restricted  3-graph,  however. 

In  [5] ,  Ferguson  also  mentions  that  the  outstanding  unsolved 
problem  Is  the  3-step  evasion  game.  He  claims  that  the  best  E 
can  do  using  the  Markov  Hypothesis  is  (9^3-15) /2  ■  .294...,  but 
(In  his  words),  "It  Is  unknown  whether  or  not  this  ...  Is  optimal. 

In  fact.  It  has  been  conjectured  that  no  strategy  with  finite 
memory  (that  is,  a  strategy  that  depends  only  on  the  last  m  moves 
for  some  finite  Integer  m)  Is  optimal  for  the  three-move  lag 
problem."  Thus,  the  Markov  Hypothesis  has  not  only  not  been  proved 
(except  for  n  <■  1,2),  but  Its  truth  is  actually  In  doubt.  Before 
exploring  the  reason  for  this  doubt,  however,  we  will  first  Inves¬ 
tigate  the  numbers  V  that  are  obtained  as  "game  values"  when  the 

n 

Markov  Hypothesis  Is  employed  In  the  n-step  evasion  game. 
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According  to  the  Markov  Hypothesis  E  controls  2**'^ 
variables,  each  being  the  pxobaSUlty  of  going  (say)  to  the  right, 
given  that  the  previous  n  -  1  st^s  have  been  In  a  certain 
sequence.  He  can  exploit  the  obvious  right/left  syss^try  by  con¬ 
sidering  only  paths  where  the  last  step  Is  to  the  (say)  left.  In 
which  case  there  are  only  2  variables  at  E's  disposal.  Equi¬ 
valently,  the  variables  can  be  regarded  as  probabilities  of  turning 
given  one  of  the  2  possible  previous  sequences  of  turns.  For 
each  of  these  sequences,  E  nust  assure  that  the  probability  of 
being  at  any  of  the  n  +  1  points  reachable  in  n  steps  Is  ^  V^, 
so  that 


Vi  •!» 

“  2®"^  variables 


f(irt-l)2®  ^  functions 
*  n-2 

!  of  2“^^  variables 


ij^2 

In  general,  we  can  expect  that  about  2  +  1  of  the 

functions  will  be  equal  fdien  the  variables  are  optlaue,  since  this 
establishes  as  nany  equations  as  unknowns,  with  the  rest  of  the 
functions  taking  on  SMller  values.  Evidently,  the  "controlling 
functions"  (the  ones  that  are  equal)  will  becoae  a  snaller  propor¬ 
tion  of  all  functions  as  n  grows  large.  Same  Idea  of  which 
functions  will  be  controlling  can  be  obtained  by  exaalning  In 
detail  the  results  for  the  2,  3,  and  4  step  gases,  idilcb 

are  shown  In  Figures  5  and  6.  The  results  for  n  ■  2  are  Isaacs  . 


^The  first  proof  that  V-  -  .382...  Is  actually  due  to  Dublns  [4]. 


16 


The  results  for  n  •  3  are  Ferguson's.  The  results  for  n  *  4 
are  new.  The  probabilities  shown  In  Figures  5  and  6  are  the  prob¬ 
abilities  that  E  will  be  at  the  various  points  when  using  the 
associated  optimal  turn  probabilities;  P(t|tn)  Is  "the  probability 
of  turning  If  the  previous  move  was  a  turn  and  the  move  before  that 
was  not."  The  controlling  functions  are  the  ones  that  are  equal  to 
the  bound  on  the  game  value  (underlined)  In  the  optimal  solution. 

The  four  step  game  shows  that  the  following  two  propositions 
are  false: 

1)  When  E  uses  his  optimal  (Markov)  strategy,  A's  choice 
of  when  tc  fire  Is  Immaterial  (A  must  not  fire  after 
NN), 

2)  In  E's  optimal  strat^y,  the  probability  of  turning 
depends  only  on  the  time  since  the  last  turn 
(P(t|TT)  ^  f(t|th)). 

On  the  other  hand,  one  striking  characteristic  of  the  4-step 
game  Is  that  the  optimal  turn  probabilities  are  all  very  nearly 
equal,  so  that  the  approximation  resulting  from  the  assumption  that 
they  are  equal  might  not  be  a  bad  one.  At  n  -  4,  the  best  single 
turn  probability  Is  .3015...,  with  the  resulting  bound  being 
.2380...  .  For  large  n,  assuming  that  there  Is  a  constant  turn  prob¬ 
ability  at  each  step,  the  time  between  turns  would  be  approximately 
exponentially  distributed,  so  that  formula  (1)  should  apply.  How¬ 
ever,  formula  (5)  gives  too  large  a  kill  probability  (.32  at  n  ~  4) 
because  the  e~*’'  term  Is  free  to  A  In  the  continuous  game,  whereas 


2  -  STEP 


1^|T)*.M2...  V^*.3e2... 


P(T|T)  •.267... 
P(TlN)  ■  .366... 
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FIGURE  9. 

THE  TWO  AMO  THREE  STEP  GAMES. 
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FIGURE  6. 

THE  FOUR  STEP  GAME. 
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It  la  not  In  tha  dlacrata  (ana.  In  the  dlacreta  ^ana,  (3)  ahould 
ba  replacad  by 


p(o)  -  nax  {a~®,  ^  ^  }  (6) 

which  la  nlnladxad  idian  the  two  quantltlea  are  equal.  A  fomula 
for  the  nlnlOTi  (P|,)  aa  a  function  of  n  can  be  found  by  an 
anelyala  aladlar  to  that  leadlag  to  (5).  Flrat,  let  x  >  /2/». 

Thn  p^  ■  a"^,  x  ■  tT^/ ^at  y  =  P|^/x  ■  ,  and  conaequently 

y^  +  log  y  ■  -  log  X  (7) 

For  n  -  4.  (7)  glvea  p^  -  .202.  which  la  too  low.  tt.e. 

n  la  very  large,  tha  log  y  ten  In  (7)  can  be  neglected,  giving 
P|^  K  x/-log  X,  or 


Pr  ’  4^  (nt^l) 

-  (.796)  ^  /.22  +  log  (ttfl)  (8) 

Conpare  (8)  and  (5)  for  a  *  l/(n:fl). 

Dlacreta  Bvaaion  Ganaa  with  tha  nwber  of  alanltanaoua 
attacker  ahota  being  larger  than  1  have  not  been  Inveatlgated. 

E'a  atratagy  la  aanaltlva  to  thla  nunbar;  In  the  2-atep  gaae. 


for 


I 

t 

I  18 

i 

iMtanee,  th«  game  value  whan  A  haa  2  shota  (uaing  the  Harkov 
Hypothasla)  la 

1  -  max  ■in((l-'x)2,  x(l-x)}. 

X 

Tha  optiaal  x  la  .5,  which  la  larger  than  the  .382...  that 
B  uaea  when  A  only  hita  1  ahot.  Note  that  E  tuma  aore  often 
agalnat  the  atronger  opponent;  thla  la  In  contraat  to  hla  behaviour 
In  the  contlnuoua  veralon  of  the  gaae  If  he  la  reatrlcted  to  expo¬ 
nentially  dlatrlbuted  tlaea  between  tuma. 

It  waa  aentloned  earlier  that  there  la  aone  doubt  that  the 
Markov  Bypotheala  la  true  for  n  a;  3.  The  next  aectlon  ahould 
provide  aoae  Inalght  Into  the  reaaona  for  thla  doubt. 
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3.  Pr«dlett<m  C«— » 

Ons  of  th«  things  that  coapllcstss  Evasion  Ganes  is  the 
fact  that  thate  are  Many  diatlxiet  sequences  of  aoves  that  lead  to 
each  of  the  n  -f  1  points  reachable  In  n  steps,  except  for  the 
2  extrsns  points.  This  conpUcatlon  Is  nlsslng  In  Enlsslon  Predic¬ 
tion  Ganesi  the  Attacker  (we  will  now  call  hln  the  Predictor)  wins 
unleae  the  taltter  (Evader)  enits  a  specific  sequence  of  characters 
innedlately  after  die  Predictor  **flres.”  Mote  that  such  ganes  are 
trivial  If  the  specific  sequence  Is  all  die  sssk  character,  since 
E  will  salt  tha  character  continually  and  win.  E  -  P  ganes  were 
Introduced  by  Blackwell  [6],  who  observed  that  tbeorens  of  Held 
and  Karlin  laply  that  sll^tly  nore  general  games  have  a  value,  and 
that  E  has  a  good  strategy  that  Is  stationary  in  the  followli« 
sense:  Let  A  be  the  finite  alphabet  of  characters,  and  let  e 

n 

be  any  eequence  of  h  characters.  Then  E  has  an  optlaal  strategy 

P(*)  such  that  P(ng)  la  the  probability  that  the  first  n 

charaeters  will  be  e  ,  and  also  P(e  )  ■>  TP(x,e  ).*  The  last 

n  n  n 

equation  says  that  e  Is  Just  as  likely  to  be  eaitted  at  step  2 

II 

as  It  Is  at  step  1,  and  the  stateaent  easily  generalizes  to  step  K. 

Blackwell  goes  on  to  solve  the  EPIO  gaae  (the  sequence 
la  {1,0}),  finding  that  the  value  of  the  gane  Is  and  that  an 
optlaal  strategy  for  B  Is  therefore  to  choose  each  character  by 
toasli^  a  coin.  Mote  that  this  strategy  for  E  Is  Markov  (no 

*Blaekwsll's  proof  Is  for  A  -  {0,1},  but  the  generalisation  Is 
straightforward . 


■•■ory  required)  as  well  as  stationary.  F  l^is  only  .^«09tlsial 
strategies. 

In  [7],  Matula  carried  on  tlw  study  of  EP  gases.  He 

found  that  the  sixe  of  the  alphabet  is  unlaportant  as  long  as  the 

list  of  characters  that  P  oust  predict  will  not  occur  is  “selfo 

disjoint"  in  the  sense  that  no  teminal  segment  is  identical  to 

any  initial  segment.  -For  exs^ile.  1100  is  self  disjoint,  but  101 

is  npt.  If  there  are  1  m  2  characters  in  the  self  disjoint  list, 

1  1 

then  the  value  of  the  game  is  "  T 

totlc  to  l/(le).  It  is  interesting  to  note  that  the  value  of  the 
game  would  be  1/1  if  P  were  denied  all  Information  about  E's 
eadnsions,  so  that  the  value  of  Infonsatlon  can  be  exactly  assessed 
in  this  case. 

The  strategies  used  by  P  and  E  in  guaranteeing  V  are 
of  considerable  interest.  The  Predictor  Ignores  E's  emissions 
except  that  he  takes  note  of  those  instants  of  time  tj  when  E  has 
just  completed  a  transmission  of  the  list,  with  t  >  0  being  such 
a  time.  At  each  such  moment,  if  be  has  not  yet  made  his  predic¬ 
tion,  P  picka  a  random  number  X  ^th  P(X>i)  >  p^, 

1  *  0,1 .  If  the  next  coiivlete  transadjsslon  of  the  list  has 

not  occurred  by  time  t^  +  Z,  than  B  predicts  that  the  next  ^ 
charactera  after  X  will  not  be  the  list;  otherwise,  P 

repeats  the  procedure.  Let  K  ■  tj^j^  ”  ^j*  Xml,  since 

the  list  is  self  disjoint.  The  probability  that  P  will  make  a 
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prediction  is  p^  4-  pj^_j^>  end  the  probability  that  P  will 

lose,  given  that  he  predicts,  is  ^^0^" *^K-1^ '  Therefore, 

if  the  probabilities  p^  are  chosen  in  such  a  Banner  that 
P|^_j^  .ic  for  ail  K  >  X,  then  0  is  s  bound  on 

the  gaae  value  enforceable  by  P.  Matula  shows  that  such  "distri¬ 
bution  bounded  densities"  exist  if  0  >  but  not  if  0  ••  V^. 

Zn  other  words,  these  densities  are  6-optiaal  strategies  for  P. 

gsae  BP  .1100  will  serve  to  Illustrate  an  optiaal 
Better  strategy.  There  are  four  characters  in  the  list,  which 
we  rsTlable  a,  b,  c,  and  d.  E  first  ealts  the  character 
"a,"  and  then  generates  a  Markov  chain  with  transition  probabili¬ 
ties  P(bU)  -  P(clb)  -  P(dlc)  -  3/4,  P(alx)  -  P(xld)  -  1/4  for 

X  ■  a,  b,  c,  d.  Mote  that  no  natter  what  E  has  just  SBltted,  he 
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will  next  emit  the  list  abed  with  probability 

that  the  given  strategy  for  E  (call  it  S)  is  optiaal.  Moreover, 

S  Is  obviously  Markov  if  E's  eaisslon  is  regarded  as  a  sequence 
of  letters,  and  has  an  ultiaate  stationary  distribution.  But  consider 
what  happens  when  the  letters  are  translated  into  O's  and  I's. 

The  generated  sequence  will  still  be  ultlaately  stationary,  but  it 
will  no  longer  be  MarkovI  To  show  that  this  is  the  esse,  let  p 

n 

be  the  probebllity  that  the  first  n  synbols  will  be  "1."  Then 

Pj^  1,  since  the  first  letter  is  a,  and  P2  ~  1,  since  the 

second  letter  is  either  a  or  b.  Moreover,  p^  aust  satisfy 
1  13 

p^2  ■  solution  of  this  equation  for 

idilch  Pi  “  P2  ■ 


1  is 
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Since  ie  not  a  constant  for  n  2  n^  for  some  n^,  S 

la  not  Harkov  of  any  order.  In  other  words,  no  finite  aeaory  will 
do  for  B  if  he  attenpts  to  reaeaber  only  O's  and  I's.  Further- 
Bore,  Hatula  proves  that  all  of  B's  optlnal  strategies  are  non- 
Markov  in  the  sane  sense.  This  is  in  contrast  to  the  gaaes  EPIO 
and  BPIOO,  idiere  E  does  have  an  optimal  Markov  strategy.  Ferguson 
had  these  facts  in  mind  when  he  made  the  quote  on  page  14,  to  the 
effect  that  the  Markov  Hypothesis  may  not  hold  for  the  .3-step 
evasion  game. 

Matula  also  solves  certain  classes  of  EF  games  where  the 
list  la  not  self •disjoint,  but  some  EP  games  have  not  been  solved. 


4.  The  Filtering  Approach. 

"Optlaal  Filtering"  Is  concerned  with  the  prediction  of  e 
signal  when  It  Is  edcoapanled  by  noise.  The  source  of  the  noise  Is 
nomally  thought  of  as  Is^artlal,  but  there  la  no  reason  In  the 
theory  why  the  noise  could  not  be  deliberately  created  by  E  In  an 
attempt  to  make  A'a  Job  difficult.  It  seems  natural,  then,  to 
atteiq>t  to  apply  the  theory,  which  Is  Substantial,  to  Evasion  Games. 

Consider  the  Evasion  Game  In  one  dimension,  and  let  be 
a  Stochastic  process  representing  E's  position  at  time  t.  The 
probability  law  governing  the  stochastic  process  Is  determined  by 
B,  .  subject  to  some  constraints.  At  time  t,  A  will  have  observed 
E's  motion  up  to  t,  and  must  construct  a  set  S(X^,t)  with 
Lebesgue  measore  a  la 'the  continuous  pir(d>lam  or  with  n  points 
in  the  discrete  problem,  idiere  S  does  not  depend  on  X^  for 
u  >  t.  If  A  chooses  to  fire  at  time  t  and  If  X^  €  S(X^>t), 
then  A  wins,  so  that  the  Interpretation  of  S  Is  "the  set  of 
points  at  Vhlch  A  would  fire  if  he  had  to  fire  at  tlM  t."  The 
payoff  would  then  be  sup  P(X^^|  ^  €  S(X^,t)). 

Let  us  explore  sbme  of  the  difficulties  In  applying  fUtw- 
<ug  theory  to  the  above  problem.  The  most  obvlcsis  is  that  A  is 
cKooelhg  «  sat,  rather  than  the  single  mmiber  X*<c+t)  that  la 
the  "optimal  estlmaCe'l  In  filtering  theory.  However,  we  can  get 
hround  this  problem  by  restricting  A  to  firing  at  an  "Interval" 
with  X* (tfr)  being  (say)  the  midpoint.  Thle  will  be  no  real 
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restriction  If  E  nonetheless  behaves  in  such  a  Banner  that  the 
probability  law  for  given  X^,  u  s  t  ‘  is  uniaodal. 

There  are  other  difficulties.  If  A  fires  at  tine  t,  the 
payoff  is  supposed  to  be  P(jx*<t+T)-X(t+T) |  <  y)#  with  an  analo¬ 
gous  formula  In  the  discrete  case.  However,  the  payoff  at  t  in 

most  of  filtering  theory  is  taken  to  he  the  variance  o^  = 

* 

Var(X  (t4T)-X(t-l-T)) .  ..Furthermore,  the  usual  object  to  be  minimized 
in  filtering  theory  Is  E(o^},  whereas  we  have  In  mind  a  maximizing 
operation,  corresponding  to  the  idea  that  A  picks  the  time  of 
firing.  The  expected  value  criterion  would  seem  to  apply  better  if 
an  Impartial  referee  were  to  randomly  pick  the  time  of  firing,  rather 
than  A. 

All  of  the  above  difficulties  disappear  if  E  is  restricted 
to  using  a  stationary  Gaussian  process.  Since  the  distribution  of 
X^_l_^,  given  X^  for  u  ^  t,  is  normal,  A's  best  strategy  is 
always  to  straddle  the  mean.  Furthermore,  since  the  variance  of 
that  normal  distribution  is  independent  of  X^  for  u  <  t,  o^  is 
actually  a  constant,  so  that  the  average  and  supremum  operations 
give  the  same  result.  Since  the  kill  probability  at  any  time  is  a 
given,  decreasing  function  of  o^,  the  variance  itself  can  serve 
as  a  payoff  function,  with  E  maximizing  and  A  minimizing.  In 
other  words,  if  E  is  constrained  to  using  stationary,  Gaussian 
processes,  then  filtering  theory  is  applicable  to  the  Evasion  Game. 


tfAfortuaately,  the  rules  of  the  Eveslon  Case  wake  It  iaposslble 
for  E  to  move  according  to  a  stationary,  Gaussian  process.  E's 
velocity  Is  supposed  to  be  bounded.  We  have  two  choices: 

1)  Ignore  the  problem,  and  replace  the  bound  on  the 
velocity  with  a  bound  on  the  variance  of  the  velocity. 

In  other  words,  change  the  game. 

2)  Look  for  E  strategies  for  which  the  velocity  Is 
bounded. 

We  shall  explore  both  possibilities. 

4.1  Constrained  Variance. 

References  [8]  and  [9]  are  both  applicable.  We  will  follow 

[8] ,  Wherein  the  discrete  and  continuous  problems  are  both  solved 

completely.  In  the  discrete  case,  the  velocity  Is  assumed  to 

hold  from  time  n  -  1  to  time  n,  so  that.  If  X_  Is  the  position 

K  *• 

•\*  I 

n* 

Is  assiimed  to  be  filtered 
are  Independent,  normal  random  variables  with  0  mean  and  unit 
variance.  The  variance  of  T  must  never  be  larger  than  (say)  1, 

m 

so  yar(T  )  -  T  <  1.  Thus,  a  strategy  for  E  Is  a  potentially 
j*0  ^ 

Infinite  dimensional  vector  a  with  a  constrained  norm. 

We  can  assume  that  A  fires  at  time  0,  since  the  firing 
time  Is  Immaterial.  If  the  delay  Is  K  steps,  corresponding  to 
the  K  step  Evasion  Game,  then  the  payoff  Is  VarCXj^^CT^.T^^,...)), 
where  0  Is  A's  prediction  of  based  on  what  he  knew  at 

It  Is  known  that  the  optimal  predictor  0  Is  just  the 


at  time  K, 


1  • 

noise:  T  “  T  o.U  ,, 


where  the  U. 


time  0. 
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conditional  expected  value  [10].  Thla  fact  does  npt  d^tend  on  the 

U.  being  nonal.  However,  the  fact  that  the  U.  are  noraal 
J  3 

laplies  that  the  conditional  expected  value  la  a  i^inear  fwpctlon  of 


, • • . ,  80  that  it  is  no  restriction  to  asaiae  that 

0Orn»Tf_,  ■  X-  +  \  •  Thus,  a  strategy  for  A  is  a  vector 

j-0  J  ^ 

y.  Bran  goes  on  to  express  the  payoff  as  a  function  J(a,Y)» 


subject  to  a  wild  reatrlctlon  on  y,  and  to  show  that 


win  aax  -  aax  win  J(a,Y)  - - ^ - :  .  (10) 

Y  o  o  Y  2(l-co8{5|;j-)) 

* 

Furthenore,  ~  0  for  1  ^  K  in  E's  optlaal  strategy.  At 
first  glance,  this  seems  to  confirm  the  Markov  Hypothesis  for  these 
games,  since  B  needs  to  know  only  U  U  In  order  to 

determine  However,  a  finite  memory  will  suffice  only  if  E 

remembers  U's;  no  finite  memory  will  suffice  if  E  remesibers 
T's,  contrary  to  the  Markov  Hypothesis.  This  situation  is  very  like 
the  one  encountered  in  Emission-Prediction  games;  E's  finite 
memory  is  for  something  that  isn't  observable  by  A.  This  consti¬ 
tutes  additional  evidence  that  the  Markov  ^rpothesls  does  not  hold 
in  general  for  the  n-step  Evasion  Game. 

Even  though  A  has  an  optimal  strategy  y**  tbe  results 

for  Bram's  game  are  similar  to  the  results  for  other  evasion-type 

* 

games  in  the  sense  that  y  had  infinitely  many  non-sero  components. 
If  A's  strategies  had  been  restricted  to  vectors  with  only  finitely 
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Grenaodar  finds  that  the  value  of  the  game  is  2.1  if  k  >  1,  or 
.82  if  A  sets  k  at  .12,  ehleh  is  the  optimising  value  of  k 
for  A.  Evidently,  the  game  value  is  sensitive  to  changes  in  A's 
set  of  prediction  strategies;  Grenander  finds  an  Improvosent  by  a 
factor  of  2.5  if  A  is  allowed  to  use  values  of  k  other  than 
1,  and  Bran  has  proved  that  another  factor  of  2  is  possible 
(4/«^  M  .4)  if  A's  prediction  strategies  are  unrestricted. 

As  mentioned  earlier,  the  chief  objection  to  the  constrained 
variance  approach  is  that  E's  velocity  is  not  necessarily  boxmded. 
Bounded  velocity  results  are  scarcer  and  less  satisfying  than  con¬ 
strained  variance  results,  but  still  deserve  mention. 

4.2  Bounded  Velocity. 

In  one  dimension,  the  natural  assumption  to  make  is  that  E 
travels  back  and  forth  at  top  speed,  with  the  times  between  direc¬ 
tion  changes  being  Independent  random  variables  with  coMon  D.F. 
F(x).  The  assumption  is  "natural"  more  out  of  force  of  habit  than 
through  any  Inherent  logic,  since  there  is  no  good  reason  to  suppose 
that  E's  current  decision  should  be  Independent  of  past  decisions, 
but  it  nonetheless  offers  some  hope  of  analysis.  We  earlier  inves¬ 
tigated  the  consequences  of  making  F(x)  exponential  when  the 
payoff  was  a  kill  probability  (p.  6  ).  In  [9]  Grenander  finds  the 
optimal  D.F.  under  the  assumptions  that  A  is  restricted  to  the 
extrapolation  rule  X  (t+1)  ■  2X(t)  -  X(t-l),  and  that  the  value 
of  the  game  is  to  be  the  (average)  variance  of  X(t+1)  -  X  (tl-l). 
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Be  finds  thet  the  tines  between  direction  changes  should  be  geonetrlc: 
P(I^  "  n)  "  ,  n  >  1,2,...,  which  Is  the  sane  as  saying  that  E 

flips  a  coin  every  tine  unit  to  decide  which  way  to  go  next.  If 
the  top  speed  la  1,  the  value  of  the  gasie  is  1.  It  should  be 
esyhaslsed  that  this  gane  value  is  an  average  variance: 

V  -  E(d2)  .  E(Var(X(t+l)-X*(t+l))). 

1  12 

For  the  proposed  strategy  for  E,  o^  turns  out  to  be  -r ‘I' 
for  0  <  t  n  1,  with  period  1.  It  is  true  that  o^  dt  -  1, 

Jo  ^ 

but  nln  o^  *  1/2,  with  the  latter  quantity  being  the  nore  appro- 
t  ' 

prlate  payoff  If  A  picks  the  tine  of  firing.  In  other  words, 
Grenander  inpllcltly  asaunea  that  a  neutral  Agent  picks  the  tine 
of  firing  fdien  he  adopts  E(a^)  for  a  payoff. 

Grenander  also  formulates  several  genes  where  A  Is  not 
restricted  to  simple  extrapolation.  In  one  of  then,  A  is  free  to 
use  the  conditional  expected  value  as  a  predictor,  and  E  noves  In 
2  dimensions  at  unit  speed  In  a  direction  0^  that  Is  filtered, 
Gaussian  noise.  Be  solves  the  problem  In  case  V  =  Var(0^)  Is 
small,  finding  that  the  game  value  (variance  of  prediction  error) 
is  (4T^/v^)V.  Note  the  slnilarlty  of  this  result  to  Bran's  In 
one  dimension;  the  optimal  filter  for  E  is  also  similar. 
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S.  Su—ary. 

The  matheaatlcal  attack  on  the  Boaber  va.  Battleahlp  gaaa  baa  been 
proceeded  by  the  two  tine  honored  taotica  of  approxlaately  aolvlng 
the  actual  problem  and  actually. aolvlng  the  approaleata  problem. 
Unfortunately,  neither  approach  haa  worked  very  well;  the  upper 
and  lower  bounds  on  the  actual  problem  are  not  very  close  to  each 
other,  and  the  approximate  games  that  have  been  solved  do  not  re¬ 
semble  the  Bomber  vs.  Battleship  game  very  closely.  A  great  deal 
has  been  learned,  but  the  really  practical  problems  have  yet  to  be 
solved. 

One  of  the  most  Intriguing  questions  that  remains  unanswered 
concerns  the  Markov  Hypothesis  for  the  n-step  Evasion  Gasss.  Results 
for  similar  games  Indicate  that  the  hypothesis  as  stated  earlier 
probably  does  not  hold,  but  that  E  nonetheless  has  an  optimal 
strategy  wherein  he  needs  to  remember  only  n  -  1  quantities.  The 
question  is,  "Hhat  quantities?,  and  what  is  the  napping  from  these 
quantities  to  the  actions  that  E  must  take?" 

There  are  other  questions  that  need  to  be  answered.  Wiat 
happens,  for  Instance,  If  the  Attacker's  endurance  Is  not  large 
compared  to  the  time  lag,  or  If  his  observations  are  In  some  way 
noisy?  The  potential  for  useful  research  In  the  field  Is  far  from 


exhausted 
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